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Abstract 

We study the deterministic dynamics of networks Af composed by m non identical, 
mutually pulse-coupled cells. We assume weighted, asymmetric and positive (coopera- 
tive) interactions among the cells, and arbitrarily large values of m. We consider two 
cases of the network's graph: the complete graph, and the existence of a large core (i.e. 
a large complete subgraph). First, we prove that the system periodically eventually 
synchronizes with a natural "spiking period" p > 1, and that if the cells are mutually 
structurally identical or similar, then the synchronization is complete (p = 1) . Second, 
we prove that the amount of information H that Af generates or processes, equals log p. 
Therefore, if Af completely synchronizes, the information is null. Finally, we prove that 
Af protects the cells from their risk of death. 
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1 Introduction 

The theory of deterministic dynamical systems composed by two or more coupled dynamical 
units assumes that each unit - which we call cell - has a proper own dynamics, and that the 
couplings among the units are interactions that depend on the instantaneous states of the 
cells [42, 10]. 

Among the systems of interacting units, we focus on those that are pulsed-coupled (i.e. 
the interactions are instantaneous). In particular, the global system can be understood as 
a multi-dimensional differential or difference equation with impulsive terms (e.g. [25]). 

On the one hand, the theory of dynamically interacting units is a source of mathematical 
open questions (e.g. [42]). In particular, those systems governed by impulsive differential 
equations (e.g. [35]) pose mathematical problems that are mostly open, except in particular 
cases or low dimensions. On the other hand, dynamical systems composed by interacting 
units, and in particular those that are pulsed-coupled, have relevance in many applications. 
As examples in Physics, a two-dimensional impulsive differential equation models the joint 
dynamics of two or more coupled oscillators (e.g. [34]). In particular, they are used in 
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applications to Light-Controlled-Oscillators (LCO), e.g. [32]. The mathematical investiga- 
tion of a genetic regulatory network of two antagonist genes, is also modeled as a network 
of pulse-coupled units [12]. In Neuroscience, among the theoretical methods of research, 
the mathematical analysis of the dynamics of pulse-coupled networks is applied [15, 19]. 
In Engineering, networks of coupled dynamical units are designed for control systems and 
communications [41]. Computational research on artificial intelligence, by means of artifi- 
cial neuronal networks, is used to analyze, simulate, and investigate on data obtained from 
dynamical systems of interacting units with a large degree of complexity [11]. In Economics, 
networks of coupled units are used to investigate the equilibrium states in social systems 
of interacting agents [1]. Artificial neuronal networks are applied for the prediction of the 
exchange market [28], also to investigate on financial markets [24], and for the accounting 
of financial applications [18]. In Ecology, networks of interacting units model the dynamics 
of predator-prey communities of two or more species [37, 16]. The dynamics of an infec- 
tious disease, taking into account the interaction among populations of diverse infectious 
agents, is modelled as a neural network [33]. In Geosciences, the forecast of ozone peaks 
in weather prediction uses computational methods on artificial neuronal networks [13]. In 
Social Sciences, the dynamics of large WWW social networks is mathematically modelled 
by the interactions of their individuals [29, 39]; and the self- synchronization of many small 
clusters of cells in a low-dimensional network models the dynamics of a medieval social 
network [3]. 

1.1 The object and method of research 

Along this paper we investigate, by exact mathematical analysis and deductive proofs, the 
global dynamics of certain pulse-coupled deterministic networks of m cooperative cells, for 
large values of m. 

Each cell i G {1, 2, . . . , m} is governed by a deterministic dynamical sub-system, which 
- if i were hypothetically isolated from the network - we call the free dynamics of i. Besides, 
each cell i acts on the other cells j ^ i of the network at certain instants ti, which we call 
the spiking or milestone instants of i. Conversely, each cell i receives the actions from the 
other cells j ^ i at the spiking instants tj of j. 

The free dynamics of each cell (cf. §7.2) evolves governed by a finite-dimensional ordi- 
nary differential equation, joint with an autonomous and instantaneous reset or update rule. 
The update rule applies when the state of i arrives to a pursued goal or threshold level 9i. 
The update rule resets the state of z, or equivalently, it changes the velocity according to 
which the free dynamics evolves. The free dynamics of the many cells of the network may 
be mutually different. As a particular case, in Neuroscience the model of the free dynamics 
of each cell - by integration of a differential equation plus a reset or update rule - is called 
integrate and fire. Each reset or update event of the cell (the neuron) is called a spike. In 
brief, the spike of a cell i is produced when it arrives to its goal 9i. 

The cells compose the network by mutual interactions between any ordered pair (i,j) 
such that 1 < i,j < m and i ^ j. These interactions exist in both directions (some 
interactions may be zero), but are neither necessarily symmetric nor simultaneous. Roughly 
speaking, the action from the cell i to the cell j ^ i is a discontinuity jump Ajj - applied on 
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the state of j - that is produced at the instant ti when i spikes. So, the instant tj depends 
on the state of i. The rule is the same to define the action from the cell j to the cell i, but 
the matrix (A)jj is not necessarily symmetric, i.e. the value of Aij may differ from Aj^i. 
Besides, the instant ti in general differs from the instant tj. 

Our purpose of research is to find qualitative and quantitative relevant characteristics of 
the global dynamics of such an abstract network, while time t evolves to the future. As said 
above, the methodology is to find the exact abstract mathematical statements and their 
deductive proofs. 

We take the main ideas from [7], in which a model of a network, composed by integrate 
and fire biological neurons, is studied by the exact mathematical method. 

The main differences between the dynamical system that we study here and the one 
studied by [7], are the following: First, we assume that the cells are cooperative (which in 
Neuroscience are called excitatory). This means that Ajj- > for all ordered pairs 
such that i ^ j, and the value zero is admitted in some of our results. In [7], any sign of Ajj 
is admitted by hypothesis, but only nonzero values are assumed. Second, we do not assume 
that the free dynamics is the same for all the cells. In [7] all the cells are identical. Finally, 
we neither assume the linearity of the differential equation that governs the free dynamics 
of each cell, nor the existence of a Lyapunov stable equilibrium state for the solution flow 
of this differential equation. 

The mathematical model of the network M that we study in this paper can be considered, 
in a wide sense, an evolutive game represented by a graph with bi-directed weighted edges. 
The cooperativism hypothesis in the interactions among the individuals works similarly 
to the imitate the best strategy in the game, which produce players that slowly adopt a 
myopic behaviour ([17]). In fact, by hypothesis, the cells ignore the global behaviour of 
the whole network. Nevertheless, the model that we study differs from the models that are 
usually investigated in Game Theory, even from those that focus on evolutive games (e.g. 
[17, 1, 26]): For instance, in our case, each cell or player i decides the instants when it acts in 
the network, by integrating the states of its own internal dynamics with the actions that it 
had received from the other players. In other words, there does not exist a forcing external 
mechanism that makes all the players interact neither simultaneously nor continuously on 
time sharing a resource. As a counterpart, the cell has no alternative to decide, among 
several strategies, its actions on the network. Each cell is not an optimizer. It is just a 
deterministic dynamical system whose state suffers instantaneous changes according to the 
states of the other cells, and conversely. 

1.2 The hypothesis 

We adopt three types of hypothesis. First, we assume that the number of cells - in a part or 
the whole network - is large enough with respect to certain other parameters of the network 
(Inequality (11) of Theorem 2.6 and a similar inequality in Corollary 2.12). Second, we 
study the cases for which cells are cooperative (cf. Definition 2.2). Third, we assume that 
the network's graph is complete, or, if not, that there exists a large full cooperative core 
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(i.e., a complete subgraph of cells which are fully cooperative, cf. Definition 2.11). 
1.3 The results to be proved 

Under the hypothesis above described, we prove three results: the periodic eventual syn- 
chronization, the positiveness of the protection factor of the network against the risk of 
death of its cells, and the value of the total amount of information that the network is able 
to generate or process. 

1.3.1 Results about synchronization 

In Theorems 2.6, 2.7 and Corollary 2.12, we prove that the network necessarily self-synchronizes 
the spikes of clusters of cells periodically, after a transitory waiting time, and that this be- 
haviour is robust (i.e. it persists under small perturbation of the numerical and functional 
parameters of the network). After the transients, the synchronized clusters are independent 
of the initial state. But the finite transitory time-interval itself, does depend on the initial 
state. 

We give the word "synchronization" an exact mathematical meaning (cf. Definitions 
3.2 and 3.1). By eventual periodic spike-synchronization, we mean that interactions among 
all the cells within the same cluster are produced simultaneously, infinitely many times in 
the future and periodically - but not necessarily at all the spiking instants of the network 
(Definition 3.2). Nevertheless, this definition is rather non-standard in Physics. (For the 
concept of synchronization and phase locking in Physics see for instance [30].) In fact, the 
classical definition of synchronization requires all the cells be identical (e.g. [27]). But 
along this paper, we are not assuming the hypothesis of identical cells, neither in the whole 
network nor in a part of it. 

Joining the results of Theorems 2.6 and Theorem 2.10, we prove that the events' syn- 
chronization of more than one cluster is produced only if the cells are mutually different. 
In other words, if all the cells are structurally identical - also if they are non identical but 
similar - we prove that all the events of the whole network synchronize, after a transitory 
time-interval and from any initial state (Theorem 2.10, Part (a)). In brief, networks of 
similar cooperative cells form a unique spike-synchronized cluster. 

In their seminal article [27], Mirollo and Strogatz proved that networks of identical fully 
cooperative cells, with constant interaction Aij = A>0\/i^j, synchronize all their 
spikes. In [2], Bottani proved a very general result under a certain stability hypothesis, 
stating the synchronization of complete networks composed by a large number of excitatory 
neurons (i.e. cooperative cells) that are modelled as integrate and fire oscillators: Either 
all the oscillators evolve synchronized in block, or subsets of synchronized oscillators ap- 
pear always in stable avalanches. The synchronization of several clusters of cells, provide 
repetitive patterns that allow the network to organize the information. In Theorem 2.6 
we generalize Bottani's results to mathematically abstract networks of pulse-coupled co- 
operative cells, that are neither necessarily identical nor similar, and without the stability 
hypothesis. In Corollary 2.12 we generalize the statements for some kind of not completely 
connected networks. 
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1.3.2 Results about the protection and the amount of information 

In Theorem 2.8 and Corollary 2.12, we prove that cooperative networks with a large number 
of cells protect their cells from external negative interferences, diminishing their risk of death 
(cf. [14]). This protection is due to the synchronization of sufficiently large clusters. As 
a counterpart, in Part (c) of Theorem 2.10, we prove that if a complete synchronization is 
achieved, then the total amount of information that the network can generate, or process, 
is null (see also §7.1). But if the synchronization is not complete - as said above this occurs 
if perceptible differences exist among the free dynamics of the cells - then the network is 
able to process a positive amount of information (see Theorem 2.9, in the case that the 
spiking period p is not 1). Nevertheless, this amount of information is necessarily much 
lower than the theoretical maximum that a general network could process, according to 
the number of cells that are employed in the task. This is because, due to Theorem 2.6, 
in large cooperative networks there exist large clusters of cells whose spikes are produced 
all together. Therefore, they contribute to enlarge the number of different spiking-code 
patterns, as if each cluster had a unique cell. 

The null amount of information of the cooperative networks that completely synchronize, 
opposes to many networks composed by all antagonist cells. These latter may exhibit a large 
amount of (rather unpredictable) information. See for instance the "virtual chaos" in [8, 9], 
or the "stable chaos" in [31]. As a counterpart, the networks composed by all antagonist cells 
unprotect their cells and so, they enlarge their risk of death (cf. Remark 5.5 and Lemma 
5.6). As a consequence, if all the interactions were antagonist, the whole network would be 
in risk, since the death of many of its cells can drastically diminish the initial richness of 
its global dynamics. 

Therefore, a large network that performs both features: protects their cells and processes 
a large amount of not always structured and predictable information, should theoretically be 
composed by some cooperative cells and by some antagonist ones, in a more or less balanced 
interplay among them. Nevertheless, networks of antagonist cells (which in Neuroscience 
are called inhibitory neurons) also may synchronize and exhibit null amount of information, 
if the hypothesis of instantaneous spikes is released to take into account the delays [36]. 

Large networks of all cooperative cells with instantaneous interactions- the ones that we 
study along this paper - also show a balanced interplay between the amount of information 
and the protection of the network against the risk of death of its cells. In fact, in Theorem 
2.10, we prove that the network maximizes its protection to the cells, if they have mutually 
similar free dynamics. But if so, the total amount of information becomes zero (Part (c) 
of Theorem 2.10). In other words, if the network is able to process a positive amount 
of information, then the cells are mutually different. In particular, the time-constants of 
their respective free dynamics must be diverse. In such a case, the network may show many 
different clusters of mutually synchronized cells, and a long period p until the spike patterns 
of the whole network repeat. In Theorem 2.9, we prove that the amount of information H 
that a fully cooperative network is able to generate or process, equals log2 p. So, H is larger 
if the number of synchronized clusters and the period p are larger. 

In Subsection 2.2, we state the exact mathematical results that we prove in this paper. 
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All of them deal with large cooperative networks or subnetworks. From Section 3 to 6, we 
write their mathematical deductive proofs. 



2 Mathematical statements 
2.1 Preliminary definitions 

We call the scale of the cell the micro-scale relative to the whole network M under study. 
The state Xi of a cell i is - by hypothesis - governed by a continuous, deterministic and 
autonomous dynamical system on time t £ M, t > 0, which we call the free dynamics 
of the cell i. It evolves on a finite-dimensional, differentiable, riemannian and compact 
manifold Xi. Therefore, (maybe multidimensional) variable living on a compact 

metric space with a local euclidean structure, such that for each instant t > and for each 
initial state Xj(0), the continuous mapping $j satisfies the following equalities: 



The flow defined on a finite dimensional manifold by an autonomous ordinary differential 
equation is an example of a continuous dynamical system, and may model each cell. Each 
cell i has its own free dynamics, governed by its own rules. The spaces Xi where the 
respective states Xi of the cells live, and their dimensions, may be mutually different. 

We call the scale of the whole network the macro-scale or also, the global scale. It is 
defined by the interactions Ajj among any ordered pair (i, j), i ^ j oi different cells. These 
interactions are produced, in our case, according to certain deterministic rules that we will 
state in Definition 2.1. 

Each network M may be a cell of a larger hyper-macro network. We will not study this 
hyper- macro system, nor the role of A/" as a cell of it. Nevertheless, we assume that this 
hyper-macro system exists and may perturb the state Xi of each individual cell i in M. 

Two main concepts are the spikes or milestones and the eventual death of a cell. 

Definition 2.1 (Spikes or milestones, satisfaction Si and goal 9i) 

The spikes or milestones of a cell i are the instants ti when i sends actions to the other 
cells j of the network J\f. The spiking instants or milestones of the cell i are defined by i, 
according to the value of a real variable Si, which depends on the (maybe multidimensional) 
state Xi of the cell. Thus, Si depends on time t, i.e. Si = Si{xi{t)). We call Si the satisfaction 
variable of the cell i. This variable may be, for instance, the algebraic sum of several positive 
or negative components that depend on the state Xj. 

By hypothesis, the satisfaction variable Si, while not perturbed from the exterior of the 
cell i, satisfies the following two conditions, (2) and (3): 



Xi{t) = <^i {X^ (0) , t) , Xi (0) = $i (x, (0) , 0) , 

Xi{t + s) = $i(xi(0), t + s) = $i($i(xi(0), t), s) = ^iixiit), s) V t, s > 0. 





dSi 



where 




5fi G C^(Xi,M+), gi{xi) > \/ Xi < Xi; and 9i > 0. 
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6i is a strictly positive constant, which we call goal level or threshold level. The goal level of 
Si may be achieved at many different states Xj of the cell, i.e. there may exist many points 
Xi S Xi such that Si{xi) = 6i. Nevertheless, we assume, by hypothesis: 

3 unique Xj,reset S Xi such that S'j(xj,reset ) = 0. (3) 

By hypothesis, at instant the initial state Xi{0) of each cell satisfies: 

< 5,(xi(0)) < Oi. (4) 

On the one hand, at each instant ti such that lim^_^^- Si{xi{t)) = 6i, the cell i reacts in 
the following way: 

First, the following reset or update rule holds: 

lim Si{xi{t)) yOi =^ Xiiti) = Xi^reset =^ Si{xi(ti)) = 0, (5) 

i.e. the state Xi of the cell i jumps to Xj^reset at infant t^. Thus, the satisfaction variable 
resets to zero at each milestone- instant. 

Second, the cell i "produces" an spike at each milestone-instant ti, i.e. i plays in the 
game M when its satisfaction variable Si arrives to the goal 9i . At instant ti the cell i sends 
instantaneous signals Aij to the other cells j ^ i. 

On the other hand, when one and only one cell j ^ i is spiking at an instant tj (tj may 
be different from ti), it sends to i a signal Aj^i > (in general, Aj^i ^ Aij). In such a case, 
by hypothesis, the state Xi suffers a discontinuity jump such that: 

Si{xi(tj)) = Si{xi{tj)) + Aj^i if < 9i and > 0, Si{xi{tj)) = otherwise. (6) 

(We denote Si{xi{tj)) = lim, Si{t).) 

■' j 

Finally, by hypothesis of the model, if all the cells of a nonempty set /„ = {ji, ■ ■ ■ ,jk} 
- oi k different cells - spike simultaneously at some instant, say tn, and if A^^j > for all 
j S /„ and for all i ^ In, then the state Xi of any other cell i ^ In suffers a discontinuity 
jump such that: 

Si{xi{tn)) = Si{xi{tn)) + ^ Aj^i if < 9i and > 0, Si{xi(tj)) = otherwise. (7) 

(We are not defining other hypothesis when negative interactions exist. This is because, 
along this paper, we are studying networks with non negative interactions among its cells). 

Definition 2.2 (Cooperative and antagonist cells) 

We say that a cell j is cooperative if Aj^i > for all i ^ j and maxj Aj^i > 0. 
We say that a cell j is fully cooperative if Aj^i > for all i ^ j. 

We call such a network (fully) cooperative if all the cells of network are (fully) coopera- 
tive. 

Formulae (6) and (7) shows that when each cooperative cell j spikes, then it contributes 
to enlarge the values of the satisfaction variables Si of the other cells i ^ j. Thus, j helps 
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the other cells i to approach to their respective goal levels, and so, it shortens the waiting 
times until the milestones of the others occur. 

We say that a cell j is antagonist if Aj^i < for all i ^ j and miuj Aj^i < 0. 

We say that a cell j is fully antagonist if A^.j < for all i ^ j. 

When an antagonist cell j spikes, it reduces the values of the satisfaction variables Si of 
the other cells Thus, j enlarges the waiting times of the others to arrive to their respective 
goal levels. 

We say that a cell j is mixed if there exist ii ^ j and 12 7^ j such that Ai-^j > and 



In this paper, we will focus on networks or subnetworks having all cooperative cells. 

Definition 2.3 (Negative external interferences) 

By Equality (2), while the free dynamics of a cell is not negatively perturbed by external 
agents, and while the satisfaction variable Si of the cell i does not arrive to its goal level, 
it is strictly increasing on time (because, by hypothesis gi > 0). In other words, each cell 
is "born optimist": if free, it approximates with positive velocity to its goal. Besides, the 
instantaneous velocity gi{xi) is bounded away from zero, because min^^.gXi gi{xi) > exists, 
due to the compactness of the space Xi and the continuity of gi. So, if free, each cell arrives 
to its goal after a finite time. Nevertheless, if a negative term —6i < is added to the real 
function gi, the velocity dSi/dt will decrease, and may also become negative. 

We call a negative number —5 < negative differential interference to the cell i from 
its external environment (precisely, from the exterior of the network) , if during an interval 
of time, the differential equation (2) is substituted by 



We call a negative number — A < negative impulsive interference to the cell i from 
its external environment (from the network or from the exterior of the network) , if at some 
instant t for which the satisfaction variable Si has not arrived to its goal level, the state Xi 
of the cell suffers a discontinuity jump such that 



Definition 2.4 (Death of a cell) 

The death of a cell i (cf. [14]) occurs at an instant T > 0, if for any time t > T the cell 
i does not spike. In other words, after a cell i dies, it does not arrive to its goal anymore, 
and so, it stops sending actions to the other cells of the network forever. 

In Section 5, Definition 5.1, we state a numerical formula to measure the theoretical 
intrinsic risk Ri of death of any cell under eventual negative interferences, if it were not 
connected to the cooperative network. In Definitions 5.3 and 5.4, we pose formulae to 
measure the net risk of death R'- < Ri, if the cell i is interacting in a cooperative network, 
and thus, the protection factor Pj > that the network provides to i (Lemma 5.6). 

Definition 2.5 (Space of parameters) 



Ai,j < 0. 




dSi 



(8) 



S^{xi{t)) = S^ixiit-)) - A. 
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Let be a network with m > 2 fixed cells. The parameters of the network are: 



Param(AA) := [{^i^ 9i)} {a^j} 



l<i,j<m, iy^j 



(9) 



where, according to Definition 2.1, gi is the given C real function in the second member 
of the differential equation (2) which governs the free dynamics of the cell i; 9i G is its 
goal level; and Ajj- S M is the interaction in the network from the cell i to the cell j ^ i. 

In the space of all the parameters of a network with exactly m cells (for m > 2 fixed), 
we define the topology induced by the following metric (distance), where the parameters 
of the networks J\f and J\f' are defined by Equality (9); those denoted without ' (with ') 
correspond to the network M (resp. M'): 



In the above equality, || • ||(7i is the C norm in the space of all the C real functions defined 
on the compact manifold Xi. 

We say that a phenomenon of the global dynamics is robust, or persistent, or structurally 
stable if the set G of parameters of the networks for which the phenomenon occurs is open. In 
other words, if a phenomenon is robust and if Param(A/') € G, then Param(A/'') still belongs 
to Q for any sufficiently small perturbation M' of the network J\f (openness condition). 





(10) 
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2.2 Statements of the results 

In this subsection we state the mathematical results that we will prove along the paper. 

Theorem 2.6 ("Large Cooperativity Principle") 

Let N he a network composed by m > 2 fully cooperative cells (c.f. Definition 2.2). If 
the number m of cells is large enough; precisely, if: 

V^>max|V3, max{^,: J-EAA} ^ . 

I mm{Aij: t,j eM, i^j} i' 

(where 9j is the goal level of the cell j, and Aj j is the action from the cell i to the cell j - 

cf. Definition 2.1), 

then: 

(a) From any initial state, all the cells of the network N eventually periodically synchronize 
spikes (cf. Definition 3.2). In extenso: 

There exists an increasing sequence of instants t„ — )■ +oo such that, for all n > at 
least one cell spikes at instant tn, no cell spikes during the so called inter- spike-intervals 
(tn,tn+i), and there exists a minimal natural number p > 1 (called the natural spiking 
period) such that all the cells simultaneously spike at instants 

tpi^ y h£ N. 

Moreover, the subset /„ of cells that spike at each instant t„ - called the n-th. cluster - 
composes a periodic sequence {/n}neN with period p, i.e. 

In = In+p V n G Z, 

and the length of the inter-spike-intervals also compose a periodic sequence of period p, i.e. 

tn+p+l ~ tn+p = in+1 — tn V ?1 E N. 

(b) Under the hypothesis (11), the phenomenon stated in (a) is robust (cf. Definition 2.5). 



We prove Theorem 2.6 in Subsections 3.2 and 3.3. 

We call waiting time or transitory time T (until the cells periodically synchronize spikes), 
to the minimum instant tQ > that satisfies Part (a) of Theorem 2.6. (T may depend on 
the initial state of the network). 

Theorem 2.7 (Upper bounds for the transitory time and the spiking period) 

Under the hypothesis of Theorem 2.6, the transitory time T is upper bounded by the 
following inequality: 

;— — ^ ^ i, (12) 

min \gi\Xi): Xi ^ Xi ] ) 
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and the natural spiking period p is upper bounded by the following inequality: 



^ ^ ^ maxjgj : j £ TV"} 

^- min{A,j: ij £M, i^j}' 

We prove Theorem 2.7 in Subsection 3.4. 
Theorem 2.8 (Protection factor) 

Under the hypothesis of Theorem 2.6, the protection factor Pj of the network to each cell 
i is positive (cf. Definition 5.4). So, the net risk of death R'.- of each cell i under negative 
external interferences, when it is connected to the network, is smaller than its intrinsic risk 
Ri when it is isolated from the network (cf. Definitions 5.1 and 5.3). 

We prove Tlieorem 2.8 in Subsection 5.2. 

Theorem 2.9 (Amount of information) 

Under the hypothesis of Theorem 2.6, the total amount of information H that the network 
is able to generate or process (cf. Definition 4.1 and §7.1) is 

/ maxj^i : j G M} 

H = log^p<logJl+ ^ ' ^ 



min{Aij: i,j eJ\f, i ^ j] ^ 
We prove Theorem 2.9 in Subsection 4.2. 

Theorem 2.10 (Cooperative netvi^orks of mutually similar cells) Under the hypoth- 
esis of Theorem 2.6, if besides the differences among the cells are not arbitrarily large with 
respect to the minimum cooperative interaction; precisely, if: 



min OAi min m.m.\ qA Xi) : Xi ^ Xi\] ■ rx ■ ■ *r • / o 



max eAi max max{gi{xi) : Xi e XM i<i<m^ 



. l<i<m J \ l<i<m 



then: 

(a) From any initial state all the cells eventually synchronize all their spikes (cf. Definition 
3.1). This means that all the assertions of Part (a) of Theorem 2.6 hold, and besides, in the 
particular case that the cells satisfy Inequality (14), the natural spiking period is p = 1. 

(b) After the transitory time T has elapsed, the protection factor 100 • min{l,Pj} of the 
network to each celli is 100% (cf. Definition 5.4). So, its net risk of death R'^ under negative 
external interferences is null (cf. Definition 5.3). 

(c) The total amount of information that the network is able to generate or process is zero 
(cf. Definition 4.1 and §7.1). 
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We prove Theorem 2.10 in Subsections 3.5, 4.3 and 5.3. 

Remark: In particular Inequality (14) - and thus, also the assertions (a), (b) and (c) of 
Theorem 2.10 - holds if all the cells are mutually identical, i.e. 



From the proofs of Theorems 2.6, 2.7, 2.8, 2.9 and 2.10, we deduce Corollary 2.12, that 
applies to networks whose graphs are not necessarily complete. 

Definition 2.11 (Full cooperative core) 

Let be a network. A full cooperative core in A/", if it exists, is a subnetwork A/i 
composed by fully cooperative cells, i.e. 



and such that all the cells that do not belong to A/i have non negative actions on the cells 
of J\f, i.e. 



Corollary 2.12 (Netvi^orks with a large full cooperative core.) 

Let M be a network that has a full cooperative core Mi. Assume that the number m of 
cells in A/i is large enough. Precisely, if: 



then Assertions of Theorems 2.6, 2.7, 2.8, 2.9 and 2.10 hold, where minjAjj-: i,j £ M, i ^ 
j} must be substituted by minjAjj : i G A^i, j G A/", i ^ j}. 

We prove Corollary 2.12 in Section 6. 

3 The proof of synchronization 

In this section we prove Theorems 2.6 and 2.7, and Part (a) of Theorem 2.10. 

3.1 Previous definitions and lemma 

Definition 3.1 (Spike-synchronization) 

We say that the network eventually synchronizes spikes if there exists a strictly increasing 
sequence {tnjneN of instants tn — )• +oo such that all the cells spike at instant tn for all n S N, 
and no cell spikes at instants t S (t„,tn+i) for all n G N. 

We call the time-interval {tn,tn+i) the (n + l)-th. inter- spike-interval of the network. 



e, = ej = e, gi = gj = g x yi^j, 

and if the minimum positive interaction is large enough, i.e.: 

min{Aj j : i,j£ M, i ^ j} ^ mm{g{x) : x £ X} 
6 max{g{x) : x G X} 



i G TVi =^ Ai J > V j G A/", 



i^Mi ^ Aij > V i G TV. 




(15) 
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Definition 3.2 (Periodic spike-synchronization and clusters) 

We say that ah the cells of the network eventually periodically synchronize spikes with 
period p > 1, if there exists a strictly increasing sequence {injneN of instants t„ — ^ +00 and 
a minimum natural number p > 1 such that: at least one cell spikes at instant tn for all 
n G N, no cell spikes at instants t S for all n > 0, and all the cells spike at instant 

thp for all natural number h >0. 

We call the time-interval (tni^n+i) the {n + l)-th. inter- spike-interval of the network. 
We call p the natural spiking period. 

We call the set /„ of all the cells that spike at instant tn, the n-th. cluster. 

For each fixed initial state for which the network periodically synchronize spikes, we call 
the minimum to ^ - belonging to a sequence that satisfies the above definition - the 
waiting time or the transitory time. 

From Definition 3.1, note that the network eventually synchronize spikes if and only if 
it eventually periodically synchronize spikes with period p = 1. 

Definition 3.3 (Spiking-codes and code-patterns) 

Let M a network composed by m > 2 cells. 

If {tnjneN is a sequence of instants such that at least one cell spikes at instant tn for all 
n G N, and no cell spikes during the inter-spike-interval {tn,tn+i) for all n > 0, we consider 
the n-th. cluster: 

/„ := {1 < ^ < "I : i spikes at instant 

We also call the cluster /„ the n-th. spiking-code. 
For any k > 1, and for any fixed initial state 

X(0) = {xi{0),...,Xm{0)) 

of the network, we construct the following word of clusters with length k: 

Iln.fc := {In, • • • ; In+k-l)- 

We call Iln,k the n—th. code-pattern with length k from the initial state x(0). 

We say that a code-pattern 11^ with length k is recurrent, if there exists nj — )• -|-oo such 
that 

n,^,fc = nfc VjGN. 

We denote by Vk the set of all the recurrent code-patterns with length k, obtained from all 
the initial states of the network. We denote by 

#rk>i 

the number of elements of the set Vk, i.e. i^Vk is the number of all the possible, mutually 
different, recurrent code-patterns with length k, obtained from all the initial states of the 
network. 
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Lemma 3.4 (A) If from some initial state of the network there exist two different (mini- 
mal) instants < to < tp such that all the cells spike simultaneously at tQ and at tp, then the 
network eventually periodically synchronizes spikes with some natural spiking period p > 1. 

Besides, after the waiting time to, the sequence {In}n>o of clusters is periodic with period 
p, i.e. 

In = In+p Vn>0. (16) 

Also, 

4p = {l,2...,m}, /„ {1,2... ,m} V /ip < ?i < + l)p, V /i > 0, (17) 
and the sequence {in}n>o of instants for which at least one cell spikes satisfies: 

tn+p+l — tn+p = tn+1 — tn V n > 0. (18) 

(B) // from all the initial states the network eventually periodically synchronizes spikes 
with the same period p > 1, then the number of all the possible recurrent code-patterns with 
length k > 1 is 

#Vk<p yk>i, 

and 

max(#Pfc) = p. 

k>l 

(C) If from some initial state the network eventually synchronizes all the spikes, then, the 
sequence {/n}n>o of clusters is constantly equal to the set of all the cells of the network, i.e. 

In = {1,2,... ,m} V n > 0. 

Besides 

tn+i - tn = ti - to V n > 0, tn = n{ti - to) + to V n > 0. 

(D) If from all the initial states the network eventually synchronizes all the spikes, then 
the number of all the possible recurrent code-patterns with length k > 1 is 

#Vk = l VA:>1. 

Proof: Assertions (C) and (D) are immediate consequences of (A) and (B) respectively, 
in the particular case p = 1. 

Let us prove Assertion (A) . Recall that m > 2 denotes the number of cells in the network. 

By hypothesis, all the cells of the network spike at instants to > and tp > to. Thus, 
due to the reset hypothesis in Definition 2.1, Formula (5), the state of the network at instant 
to, is 

^(^o) — ^reset '■— (^^l, reset; • • • 5 ^i, reset; • • • 5 ^m, reset) i 

where Xj^reset is the unique point in the state-space Aj that satisfies, by hypothesis, Equality 
(3). Thus 

S(x(fo)) = 0, i.e. Si{xi{to)) = V 1 < i < m. 
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As the dynamics defined by (1) is deterministic, once fixed the unique state Xreset of the 
network, a unique orbit exists in the future. Thus, translating the origin of time to to, 
and recalling Equalities (1), we obtain: 

S(x(f)) = S(x(to + {t- to)) = S(*(*(xo, to), t - to)) yt>to, 

where $ = . . . , <I>j, . . . , <I>m)- Since Si{xi(t)) satisfies the differential equation (2) for all 
t > to such that t ^ tn, and 

S(*(xo,to)) = 0, 

we have: 

x(to) = *(xo,to) = Xreset, 
S(x(i)) = S(*(*(xo,to),i-io)) = S(*(xreset,t-to)) = S(x*(t - to)) Vt > to, 

where x* = (xj, . . . ,x*, . . . , x%^) is the unique solution x*(-) = $(xi-eset; •) of the determinis- 
tic dynamical system (1) with initial state x*(0) = Xj-eset, plus the deterministic interactions' 
rule (7) at the eventual spike-instants of some cells during the time-interval {to,tp). 

By the hypothesis, all the cells spike simultaneously again at the instant tp > to- There- 
fore, S(x(tp)) = S(x(to)) = 0. Thus x(tp) = x(to) = Xreset- Then, 

x(tp) = X*(tp - to) = Xreset = X*(0). 

We deduce that the unique solution x* which has initial condition Xj-eset, is periodic with 
period tp — to (recall that, by hypothesis, to > and tp > to are minimal such that all the 
cells spike simultaneously at to and at tp). Thus, the instants t„ and the spiking-codes /„ 
are determined recursively from the unique periodic orbit x*, which implies Equalities (16), 
(17) and (18), and ends the proof of Assertion (A) of Lemma 3.4. 

Let us prove Assertion (B): 
By Assertion (A), the sequence {/n}n>o is periodic with period p. Thus, from Definition 
3.3, for any fixed natural number k > 1, all the recurrent code-patterns with length k are: 

iIo,h, ■ ■ ■ ,h-i), {h,l2, ■ ■ ■ ,Ik), ■ ■ ■ , ^^g-j 

. . . , (Jj., /r-+l ) ■ ■ ■ ) -^r+fc— 1)5 • • • ) {Ip—1 -ilp-i ■ ■ ■ 1 Ip+k—2) 

with < r < p — 1. In fact, iov n = hp + r > p the code-pattern (/„,/„_|_i, . . . ,In+k-i) 
coincides with (/,., Ir+i, ■ ■ ■ , Ir+k-i), because In = Ihp+r = Ir- So, all the code-patterns in 
the list (19) are recurrent. Two or more code-patterns in the list (19) may coincide, so the 
number of different code-patterns with length k is at most equal to the number of items in 
the list (19). Thus: 

#Vk<V V > 1. 

In the particular case that k = p, the code-patterns of the list (19) are pairwise different. 
In fact, assume that 

1) • • • ) Is+p-l ) (20) 
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for < r, s < p — 1. We must prove that r = s. 

The code-pattern Iq = {1, . . . ,m} wih appear once in both patterns (20), because they 
both have length p, which is the (minimum) period of the sequence {/n}n>i- Say Iq = 
Ir+h = Is+k with 0< h,k < p — 1. 

Both patterns in Equahty (20) coincide. Then the positions h and k are the same: 



As Iq = Ir+h = Is+kj there are two indexes r + h and s + k, whose difference is smaller 
than p, such that the respective patterns coincide with Iq = {1, . . . , m}. In other words, all 
the cells spike at two instants t^+h and tg+k such that \{r -\- h) — [s + k)\ < p. But p is the 
minimum positive natural number such that all cells spike at instants tn and tn+p for some 
n. We deduce that r + h = s + k. Since we already know that h = k, we deduce that r = s, 
as wanted. 

We conclude that all the code-patterns of the list (19) are pairwise different when the 
length k equals the period p. Thus, the number of different code-patterns with length p is 
p, ending the proof of Assertion (B) of Lemma 3.4. □ 

3.2 Proof of Part (a) of Theorem 2.6 

Proof: From Lemma 3.4, to prove that all the cells of the network eventually periodically 
synchronize spikes, it is enough to prove that there exist two instants < io < such that 
all the cells simultaneously spike at Iq and at tp. 

If for any initial condition we find a single instant to > at which all the cells simulta- 
neously spike, then, taking as new initial state x(to)) = Xj-eseti we deduce that there exists 
a second instant tp > to at which all the cells simultaneously spike. Thus, to prove Part (a) 
of Theorem 2.6, it is enough to show the following: 

Assertion (i) to be proved: For any initial condition, there exists an instant tQ > at 
which all the cells simultaneously spike. 

From any initial state xq = [xi{0), . . . ,Xm{0)) such that < ^^(^^(O)) < 9i for all 
1 < i < m, consider the state 



and the m-dimensional vector whose components are the satisfaction variables Si{xi{t)) at 
instant t > 0. 

Since each variable Si is governed by the differential equation (2) with a strictly positive 
real function gi : (which is continuous on the compact space Xj), plus the eventual 

sum of interactions Aj^j > according to Equalities (7), we deduce: 



h = k. 



Besides, since 0<r-|-/i, s-|-A;<p— 1 and 0<r, s<p— 1, we have 



\{r + h) — {s + k)\ = \r — s\ < p — 1 < p. 
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Property (ii) While no interference from outside the network appears, for each cell i the 
real variable Si is strictly increasing on t, for allt > such that Si{xi{t)) S [O, 9ij . Besides, 
except at those instants where Si is discontinuous, its derivative respect to time t exists, is 
positive and bounded away from zero, and at the instants where Si is discontinuous, the 
discontinuity jumps are positive. 

We are assuming that ^^(^^(O)) < 6i. Thus, from Property (ii), we deduce: 

Property (iii) For each cell i, there exists a first finite time ti > such that \im^_^^- Si{xi{t)) - 
Oi. Namely, for any i G {1, . . . , m} there exists a first spiking instant ti > 0. 

Consider the minimum natural number K > 1 such that 

j^:^ max{g,: j £ M} 

~ min{Aj j : i,j £ Af such that i / j} 

From Inequalities (11) and (21), we deduce: 

s/^> K. (22) 

By hypothesis, 9j > for all 1 < j < m. Denote 

< := -I < Oi ■ — < min Aj (23) 

K max 6j ij^j 

l<i<m 

For later use, we note the following property: 

If l<h<K-l, then hlj = ^ Oj < Oj, (24) 



K 

and if h = K, then K Ij = —9^ = 9j. (25) 



Assume that at the instant t > 0, at leat K cells are spiking, where > 1 is the natural 
number defined by Inequality (21). Then, for any other cell j G {l,...,m}, applying 
Equalities (7), we have: 

Sj{xj{t)) > Sj{xj{t~)) + KminAij > 
max 9j 



> (minAj,) ■ = max 9i >w^. 

^ i^j ' minAjj i<i<m ■' 

i+3 



Thus, any cell j will also spike at instant t, because its satisfaction variable Sj{xj{t)) arrives 
to the goal level 9j. Summarizing, we have proved: 

Property (iv) If at least K cells spike at an instant t > 0, then all the cells spike at the 
instant t. 
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Now, to end the proof of Assertion (i) it is enough to prove the following: 

Assertion (v) to be proved: There exists an instant T > such that at least K cells spike 
simultaneously at T . 

Let us take ti > equal to the first positive instant when at least one cell ii arrives to 
its goal level, i.e. 

Si-^{xi^{ti)~) = for some ii G {1, . . . , m,}. (26) 

Let us discuss according to two cases: either at least K cells spike at instant ti with the 
cell ii, or at most K — 1 do. 

FIRST CASE: At least K cells spike at instant ti > 0. Thus Assertion (v) holds. 

SECOND CASE: At most K — 1 cells (and at least one cell ii) spike at instant ti. From 
Inequality (22), there exist at least m — {K — 1) > — {K — 1) > 1 cells that do not spike 
at instant ti. Denote by Ai this set of non spiking cells at instant ti. We have: 

#Ai > - {K - 1) > 1. 

Using Inequality (4), for each cell j G Ai we know that Sj{xj{t^)) > 0. Since at instant ti 
at least the cell ii spikes, it sends a positive interaction Aj^j to any cell j £ Ai. Applying 
Inequalities (7) and (23), we deduce: 

Sj{xj{ti)) > Sj{t^) + Aj^ j > min Aj j > Ij y j £ Ai. 

In brief: 

Sj{x,{ti))>lj VjE^i. (27) 

Denote by t2 > ti the first instant after ti for which at least one cell i2 arrives to its goal 
level. 

Now, we discuss again two cases: either there exist at least K cells that spike at instant 
t2 with the cell Z2, or there exists at most K — 1 cells that so do. In the first case. Assertion 
(v) holds. In the second case, denote by A2 C Ai the set of cells that did not spike at any 
instant in [0,^2]- We have: 

#A2 > #Ai -{K-l)>K^- 2{K - 1). 

Since ^2 > ^ij applying Property (ii) and Inequalities (7) and (27), we obtain: 

Sj{xj{t:^)) > Sj{xj{ti)) > Ij V i G ^2- 

Since at least one cell i2 spikes at instant t2, it adds a positive jump Ajjj to S'j (xj (ig ) ) for 
all j G A2. Thus, using Inequality (23), we deduce: 

Sj{xj{t2)) > Sj{xj{t2)) + Aj2j > Ij + niin Ajj > 2lj V j G A2. (28) 

By induction on h G N"*", if 2 < h < K, assume that tf^ is the h-th. consecutive instant 
th > i/i-i such that at least one cell ih spikes, and no more than K — 1 cells have spiked 
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simultaneously at each instant ti < t2 ■ ■ ■ < t/i-i- Denote by Ah the set of cells that have 
not spiked at those instants and also do not spike at instant th- 
We have 

#Ah>m-h{K-l)>K^-h{K-l). (29) 
Arguing by induction as in Inequality (28), we obtain: 

Sjix,{th)) > hi, yjeAh. (30) 

For h = K, joining Inequality (30) and Equality (25), we deduce: 

Sj{xj{tK)) > y j eAK. 

In other words, we have proved that, if at each instant ti < t2 < ■ ■ ■ < tx-i, not more than 
K — 1 cells spike simultaneously, then, at instant tx the value of Sj arrives to the goal level 
9j , for any cell j £ Ak ■ This implies that all the cells of Ak spike simultaneously at instant 
tx > 0. Besides, from Inequality (29) there exist at least — K{K — 1) = K cells in 
the set Ak- So, we have proved that at least K cells spike simultaneously at some instant 
ti > or t2 > or . . .tx-i or tx- This ends the proof of Assertion (v), as wanted, and 
thus the proof of Part (a) of Theorem 2.6 is complete. □ 

3.3 Proof of Part (b) of Theorem 2.6 

Proof: Since the hypothesis (11) is a strict inequality, it establishes an open condition 
in the space of parameters of the network, endowed with the topology of Definition 2.5. 
Therefore, the Inequality (11) joint with any dynamical property that is deduced from it, is 
a robust phenomenon. In particular, due to Part (a) of Theorem 2.6, Inequality (11) joint 
with the eventually periodic synchronization of the spikes, is a robust phenomenon. This 
proves Assertion (b) of Theorem 2.6. □ 

3.4 Proof of Theorem 2.7 

Proof: From the proof of Part (a), the waiting time T > until the spike-synchronization 
of all the cells occurs, equals the time that takes the latest cell, say i, to arrive to its goal 
level 0i from its initial state Xj(0). The worst case occurs when the initial state Xi{0) of 
this slowest cell i is such that Si{xi{0)) takes its lowest possible value (cf. Inequality (4)). 
Thus, to consider the worst case, we assume 

S^{X^{0))=0. 

Therefore T is smaller or equal than the time constant ti of the differential equation (2), 
for the solution Si{xi{t)) with initial state Si(xj(0)) = 0, such that Si{xi{t~)) = 9i. This is 
because during the time-interval [0,ti), some other cells j ^ i might have spiked. So they 
might have injected non negative jumps Aj^i to the instantaneous value of the variable Si 
of the cell i. 
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Then, the worst case if when all those jumps are zero. Summarizing, we have 



T<ti 

and the worst case occurs if Si is only governed by the differential equation (2) for all 
t G [0, tj). Due to the mean value theorem of the differential calculus, there exists a time 
Ti £ [0, ti) such that: 



dSj 
dt 



Si{xi{tT)) - Si^xim _ ^^^^ 



t = Ti * 



Using the differential equation (2), we have: 

gi{xi{T)) > mm{gi{xi) : Xi£ Xi}. (32) 



dSi 
dt 



t = Ti 

Joining Equality (31) and Inequality (32), we obtain: 

I < ti < — - — —Y < max < — - — —Y f , 

mm{gi[Xi) : Xi e Xi} i&Af I mm{gi[Xi) : Xi e Xi} ) 

proving the first assertion of Theorem 2.7. 

Now, let us prove the second assertion of Theorem 2.7, finding an upper bound for 
the natural spiking period p. We revisit the proof of Part (a) of Theorem 2.6. We have 
defined the constant K as the minimum positive natural number that satisfies Inequality 
(21). Thus: 



K < 1 



max{6'j : j G A/"} 



mm{Aij: i,j j}' 

On the one hand, by Property (iv) in the proof of Part (a) of Theorem 2.6, if K cells spike 
simultaneously at instant ti then all the cells spike simultaneously at instant ti. On the 
other hand, at the end of the proof of Assertion (v), (second case), we found that from any 
initial state, after at most K spikes of some cells (i.e. at instant tx as latest), there exist 
K cells that spike simultaneously. We conclude that, once all the cells had simultaneously 
spiked at instant to, the minimum next instant tp > to for which all the cells spike again 
simultaneously, is such that p < K. Therefore: 

p<K<l+ ^'^^^ 



min{Ajj: i,j j} ' 

ending the proof of Theorem 2.7. □ 



3.5 Proof of Part (a) of Theorem 2.10 

Proof: 

From Part (a) of Theorem 2.6, there exists a first instant to > such that all the cells 
spike simultaneously at to. So, to proof Part (a) of Theorem 2.10 it is enough to show the 
following assertion, under the additional hypothesis of Inequality (14): 
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Assertion (vi) to be proved. // at some instant to > all the cells spike simultaneously, 
and if ti > to is the first instant after to when at least one cell spikes, then all the cells 
spike simultaneously at ti. 

Fix i, one of the cells that spike at instant ti > to. By hypothesis, the cell i has also 
spiked at instant to, but not during the inter-spike-interval {to,ti). Then, applying the reset 
rule (5), we have: 

Si{xi{to)) = 
Since i also spikes at instant ti > to, we have: 

Si{xi{t^)) = Oi. 

Therefore: 

Si{xi{t^)) - Si{xi{to)) = Oi. 

No cell spikes during the time-interval (to^^i)- Thus, Si is governed by the differential 
equation (2) during such a time-interval. Applying the mean value theorem of the differential 
calculus, there exists Ti S {to,ti) such that: 



dt 



^ Si{xi{t^ )) - Si{xi{to)) ^ Bj ^^^^ 
t = Ti *i ~ *o - ^0 



Using the differential equation (2), and recalling that Xi G Xi, Xi is compact and g is 
continuous, we obtain: 

dS ' 

= gi{xi) < ui&-K{gi{xi) : Xi£ Xi}. (34) 

Joining Equality (33) and Inequality (34), we deduce: 

a min Oi 

- _! > l<i<m 

~ max{gi{xi) : Xi G Xi} ~ max max{gi{xi) : Xi G ' 

l<i<m 

Now denote by j any cell. It spikes at instant to- Then, 

Sj{xj{to)) = o, o<s,ixjit^))<ej. 

No cell spikes during the time-interval {to,ti). Thus, Sj is governed by the differential 
equation (2) during such an interval of time. Applying the mean value theorem of the 
differential calculus, there exists Tj £ (to,ti) such that: 



dS^ 
dt 



^ Sjixjjti) )-Sj{xj{to)) ^ Sjjxjjti) ) ^^g^ 
t = Tj *i ~ *o h — to 



From the differential equation (2), we deduce: 
dS 

= gj{xj) > mm{gj{xj) : < xj < OA > min mm{gi{xi) : Xi G Xi}. (37) 

at l<i<m 
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Joining Inequalities (36) and (37), we deduce: 

mm mm{gi[Xi) : Xi e Xi}} 

l<'t<m 

Joining Inequalities (35) and (38), we obtain: 

( min min{gi{xi) : G XJ}) ( min 9i) 

n / I —w ^ \ l<i<m / \l<i<m / 

Sj{xj{t, )) > — I 

max max{gi[Xi) : Xi € Ajj 

l<i<m 

from where 

S,{xj{t-,))-d,> 

a{gi{xi) : Xi^Xi]]] ( min dA 

/ \l<i<m / ( n\ \ 

r— p — ^ — r— • max Oi - Oj > 

..iaxia^(xA: X, e XA) I max OA Vi<i<m / 

^ l<i<m 



min min 

^ \ l<i<m 



> max 9i ■ 

l<i<m 



max max{gi{xi) : Xi ^ Xi}] ( max 9i 

.<i<m J \\<i<m 

( { min min{g,j(xi) : Xi £ Xi}}] { min 9i 

\ l<i<m / \l<i<m / ^ j (39) 

( max ma.x{gi{xi) : Xi e Xi}) ( max 6i] j 

\ \l<i<m J \l<i<m / / 

By hypothesis. Inequality (14) holds. So, the factor at right (between large parenthesis) in 
Inequality (39) is bounded from below by — (miuj^j A^j)/ maxi<j<m di- We deduce: 



Sj{xj{t-^ )) - (^j > -minAjj, 



from where 



Sj{xj{q)) + min Ajj > Oj. (40) 

Since at instant ti the cell i spikes, it sends an action Aj j to each cell j. From Inequality 
(40), and from the interaction rule in Equalities (7), we get: 

Sjixjih)) = Sj{xj{t^)) + Aij > Sjixjit^)) + min Aij > Bj. 

Therefore, the variable Sj of any cell j arrives to its goal level 9j at the instant ti. Thus, 
any cell j spikes at ti, and Assertion (vi) is proved. This ends the proof of Part (a) of 
Theorem 2.10. □ 



4 The proof of the amount of information 

In this Section, we prove Theorem 2.9 and Part (c) of Theorem 2.10. We compute the total 
amount of information that the fully cooperative networks with a large number m of cells 
can generate or process. 
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4.1 Previous definition 



Definition 4.1 (Amount of information) 

Recall Definition 3.3: ij^Vk denotes the number of different recurrent code-patterns with 
length fc > 1 that the network can exhibit. We denote 

H := sup{log2(#Pfe)} bits G [0, +oo] (41) 

A;>1 

(where log2 is the logarithm in base 2). 

We call H the total amount of information that the network M is able to generate or 
process. 

Note that, since i^Vk > 1 for all k, then H > 0. 

If the supremum in Equality (41) does not exist, we agree to write H = +oo and say 
that the total amount of information is infinite. Only in this case, we define the entropy h, 
or the rate of increasing information, by 

:= limsup — — , where Hk := log2{i^T'k)- 

k-^+oo 

Interpretation of the amount of information H. The number i^Vk of different 
recurrent patterns Ilfc with length k measures the dynamical richness of M, with respect to 
the many possible finite words that the spiking-codes of its cells can show. The observed 
feature that H measures, is the combination of spiking-codes: namely, H takes into account 
the different ways according to which the clusters In at each milestone tn of the network, 
are exhibited. If the length of the observation period equals t^, then the number i^Vk 
measures the dynamical diversity of codes that can be observed. Thus, the total amount of 
information if is a quantitative index of the maximum global codified dynamical diversity 
that the network M is able to show along its recurrent evolution in the future, if the observer 
looks at each cell with an individual role. (If i ^ j, then the event for which the cell i spikes 
and j does not, is distinguished from the converse event). 

Independently of the number of cells, if the number i^Vk of different patterns with 
length k were exactly 2, then = log2 2 bit = 1 bit. In such a case, we can re-codify one 
of these two patterns by "0" and the other one by "1" . The amount of information will 
be exactly 1 bit, i.e. one single digit either "0" or "1". This argument is independent of 
the number of cells, and of the name of the cells. If only 2 different patterns are possible 
with any length, then the amount of information is H =1 bit. 

In general, 

Hk = log2(#n.) bits ^ #rk = 2^". 

If Hk is a natural number, then each possible pattern 11^ S Vk can be codified and recognized 
(or transmitted, stored, memorized, processed, etc) by using, with no redundance, exactly 
Hk digits: each digit either "0"or "1"; namely, Hk bits. 
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4.2 Proof of Theorem 2.9 

Proof: In Part (B) of Lemma 3.4 we have proved that 

max{#Pfc} = p, 

where p is the natural spiking period, i.e the period of the sequence {/njneN of spiking- 
codes. Therefore, from Formula (41), the total amount of information H that the network 
can generate or process is 

H = sup{log2(#Pfc)} = log2(sup{#7'fc}) = log2(max{#T'fc}) = logap. 

fc>0 fc>0 i^>0 

(The first equality in the above chain holds because the real function log2(a;) is increasing 
on X € M"*".) We have proved that 

H = log2 p, 

which is the first assertion of Theorem 2.9. Now, let us prove the second assertion. We use 
the upper bound of the natural spiking period p that was proved in Theorem 2.9, Formula 
(13). We conclude that 

max 9j 

i<j<™ 

min Aij 



H = \0g2P < log2 1 + 



ending the proof of Theorem 2.9. □ 



4.3 Proof of Part (c) of Theorem 2.10 

Proof: From Part (a) of Theorem 2.10, under the additional hypothesis stated by Inequality 
(14), the period p of the sequence {/njneN of spiking-codes \s p = 1. From Theorem 2.9, 
we know that the total amount of information H that the network can generate of process 
is log2p. Therefore, H = \0g2P = log2 1 = 0, as wanted. □ 



5 The proof of the protection factor of the network 

In this section we prove Theorem 2.8 and Part (b) of Theorem 2.10. We need to define how 
the risk of death of each cell and the protection factor of the network are computed. 



5.1 Previous definitions and lemma 

Definition 5.1 (Intrinsic risk of death Ri) 

In Definition 2.4 we say that a cell i dies if (due to external causes of the cell) there is 
an instant T such that for all i > T the satisfaction variable Si remains smaller than the 
goal level 9i. In brief: 

i dies ^ Si{xi{t)) < 9i V t > T for some T > 0. 
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Due to the rules of the interactions among the cehs, if a ceh i dies, it can not act on the 
network anymore (after time T). 

We measure the intrinsic risk of death Ri of the cell i, relatively to the other cells of 
the network, by the following equality: 



Ri :- 



max 9i 



(42) 



l<j<m 

where m is the number of cells of the network. Since > for all i, Equality (42) 
immediately implies the following: 

The intrinsic risk of death Ri of any cell is never null. Precisely: 



0<Ri< 1. 



(43) 



Definition 5.2 (The inter-spike-intervals of each cell i). 

Let A/" be a network with m >2 cells. (To apply this definition, some or all the cells may 
be non cooperative.) We consider the strictly increasing sequence {tn}n>o of spiking times 
tn > oi the cells of the network, i.e. at instant t„ at least one cell of the network spikes, 
and no cell spikes during the time-intervals (t„,t„+i). Even if spikes do not synchronize, 
we call {tn,tn+i) the n-th. inter-spike-interval of the network (cf. Definition 3.1). 

Recall Definition 3.3: the n-th. spiking-code In is the (nonempty) set of cells that spike 
at instant tn- Let us fix a cell i. We define the sequence {tl^^}h>i of spiking times of the 
cell i by the following equalities: 



t 



(1) 



(1) 



Ah+1) 



min{t„ > : i £ In} if i G /„ for some n > 0, 

-|-oo otherwise, 

min{t„ > tf^^ : i G I„} if « E /„ for some t„ > t['^\ 



-|-oo 



otherwise. 



We denote 



t 



(0) 



0. 



For each cell i and for each natural number h > 1 such that t^^^ < +oo, we call 
the h-spike instant or the h-th. milestone of the cell i. Therefore, a cell dies if and only if 
t^^^^^ = -\-oo for some /i > 0. 
We call the time-interval 



Ah) 



ISI 



(h) 



t 



(h) 



the h-th. inter-spike-interval of the cell i. Note that we include the instant t 
h-ih.. inter-spike-interval of the cell i. 



(h+i) 



in the 



Definition 5.3 (Net risk of death R[) 

When a cell i receives cooperative actions Aj^j > from the other cells j 7^ i of the 
network, then its satisfaction variable Si is increased, to approach (or even reach) its goal 
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6i. Equivalently, a positive action Aj ,j > can be understood, as a reduction of the goal 
level 6i substituting it by 9i — Ajj. Therefore, when a cell i receives positive interactions 
from the other cells, its risk of death diminishes. 

For each fixed cell i, and for each fixed natural number /i > 0, we denote: 

^^■■= E (44) 

J / i, i G In, tn G ISif ^ 

where tn is the n-th. instant at which some cell of the network spikes, /„ is the set of all the 
cells that spike at instant tn (cf. Definition 3.3), and ISI^^^^ is the h-th. inter-spike-interval 
of the cell i, according to Definition 5.2. 

We call Aj^'j^ the net action that the cell i receives, during its h-th.. inter-spike-interval, 
from the other cells of the network. 

If the network is not cooperative, then some of the actions Aj^i in Formula (44) may be 
negative, so the sum of all of them may be negative or null. Note that, in general, the net 
action A^'j^ depends on the initial condition of the network. 

We define the net risk of death R'f'lf of the cell i while connected to the network J\f , 
during its /i-th. inter-spike-interval, by: 



i?f^:=max(0, min/i ' "'^ 



max 9j 



■}}■ (45) 



In general the net risk of death R'f'Jj- depends on the initial condition. For simplicity 
in the notation, in the sequel we will write R'^ to denote the net risk of the cell i, when the 
network M is clear from the context, and when referring to some fixed h > 0. 

Definition 5.4 (Protection factor Pi) We define the protection factor of the net- 
work N to its cell i (during the /i-th. inter-spike-interval of the cell i), by: 

Ah) 

Pl^i:=^. (46) 

In the sequel, we will simply write Pi instead of P- 'j^, when the network Af is clear from 
the context, and when referring to some fixed h >0. 

Remark 5.5 From Equality (46), it is immediate to deduce that the protection factor Pi 
is positive (negative) if and only if the minimum net sum of actions A^'j^ that the cell i 
receives from the other cells of the network is positive (resp. negative). Therefore, if the 
network is fully cooperative, its protection factor is strictly positive, and if the network is 
fully antagonist, its protection factor is strictly negative. 
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In the following Lemma 5.6 we prove that net risk R'- of a cell that is connected to the 
network J\f, is (essentially) the product of its intrinsic risk Ri (if it were not connected to 
the network) by 1 — Pi. 

In other words, if the protection factor Pi of the network were positive, then the net 
risk Rlj^ is smaller than the intrinsic risk of death, and if the protection factor Pi were 1, 
then the net risk of death R[ would be zero. So, a cooperative network always reduces 
the intrinsic risk, and may also make it zero, if the cooperative interactions are large and 
frequent enough. 

Lemma 5.6 (Formula of the protection factor of the network) 

Let N he a (non necessarily cooperative) network and i he a cell of M . 

Let Ri he the intrinsic risk of death of the cell i if it were not connected to N , and R[ he 
its net risk of death when it is connected to J\f (according to Definitions 5.1 and 5.3). 
Let Pi he the protection factor of N to the cell i (according to Definition 5.4). 
Then: 

i?^ := maxjo, min{l, (l-P,)i?,}|. (47) 



Proof: From Equalities (42) and (46), we obtain 
(1 - P,) i?, = 



From Equality (45), i?- = max|o, min|l, 
and thus: i?'=max|o, minjl, (l — Pj) D 



max 04 

i<i<m 



5.2 Proof of Theorem 2.8 

Proof: By hypothesis the network is fully cooperative. Thus, Aj^i > for all j ^ i. By 
Equalities (44) and (46), the protection factor Pi of the network to each cell is positive. 

Since > 0, we obtain 1 — Pi < 1. Applying Formula (47) of Lemma 5.6, and recalling 
that < Pj < 1 -cf. Inequality (43)- we obtain: 

R'i < max{0, min{l, Pj}} = Pj. 

Therefore the net risk of death P^ of the cell i when interacting in the network is strictly 
smaller than the intrinsic risk Pj that i would have if it were not connected to the network. 
This ends the proof of Theorem 2.8. □ 
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5.3 Proof of Part (b) of Theorem 2.10 

Proof: First, let us prove that the protection factor Pi of the network to each cell i, 
according to Definition 5.4, satisfies 



min{l, Pi} = 1 (to be proved). (48) 

h) 



In fact, by Formula (44) the net sum of the actions ^f^If that the cell i receives from the 



other cells of the network during its h-th. inter-spike-interval {t^ ,t\ ] is 



Lillig lUD /(.-Lll. lllUCi-OJJlJVC-lliLCi Vcli yl 

Ah) 



By Part (a) of Theorem 2.10, all the cells synchronize spikes after a transitory time T. So, 
for all /i > 1 such that t^^'^^^ > T, all the cells belong to /„ for the spiking time tn = tf^^^^ . 
Thus, in Equality (49) the sum at right is realized in j G {!,..., m} such that j ^ i. Then, 

Af^ = V A,- , > (m - 1) min A^- „ (50) 

J T « 

where m is the number of cells of the network. By hypothesis. Inequality (11) holds. 
Therefore m > 3, which implies m — 1 > yjm. We deduce that: 

max Qi 

\<%<m 

m — 1 > 



min Aj^i 



Substituting in (50), we obtain: A,^^l > max 9i > 9i. Thus, — -r — > 1. Now, we apply 

' l<i<m Oj 



A 



Formula (46): Pi = — — > 1, and thus Equality (48) is proved. 
9i 

Second, we apply Lemma 5.6. From Equalities (47) and (48), and Inequality (43), we 
deduce: 

R'i = max {O, min{l, (100 - Pi)Ri }} = max{0, (1 - Pi)R,} = 0, 
ending the proof of Part (b) of Theorem 2.10. □ 



6 Proof of Corollary 2.12 

(Large full cooperative core) 

Proof: Since by hypothesis, the number m of cells of the core A/i satisfies Inequality 
(15), we can repeat all the arguments in the proof of Part (a) of Theorem 2.6 in Subsection 
3.2, by substituting the network M by the core A/i. So, we deduce that there exists a strictly 
increasing sequence {tn}n>o of instants tn — )• +oo, and a natural period p > 1, such that: 
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At least one cell of A/i spikes at each instant t„, for all n > 0. 
No cell of A/i spikes in the open time- intervals 

All the cells of A/i spike simultaneously at the instant t^p for all h> 0. 

Therefore, to prove the eventual periodic synchronization of the whole network M, it is 
enough to prove that the cells of M spike altogether at each instant t such that all the cells 
of the core A/i spike. 

In fact, we repeat, with slight changes, the proof of Property (iv) in Subsection 3.2: We 
define the minimum natural number K > 1 such that 

^ ^ maxjgj : j £ M} 

min{Aij : i e Afi, j e J\f , i^j}' 

Due to Inequality (15), the number m of the core A/i satisfies 

yM> K. (51) 

Now, we repeat the same arguments of the proof in Subsection 3.2, starting at Equality 
(23) and ending just before Property (iv): Substituting miuj^j Aij by 

min{A,j : i € Mi, j £ M ,i ^ j}, (52) 

we deduce 

Property (iv)': // at least K cells of the core Ni spike at instant t > 0, then all the cells of 
the network J\f spike at instant t. 

Since at instant thp all the m cells of the core A/i spike, and m > 3 satisfies Inequality 
(51), we obtain: 

m > \fm > K. 

We conclude that the cells of the network spike altogether at instants thp for all h > 0. 
Thus, the whole network periodically synchronizes spikes from any initial state (after a 
finite transitory time). 

Once we have proved the periodic synchronization of the network, the proof of the other 
assertions under the hypothesis of Corollary 2.12, follow the same arguments in the proofs 
of Sections 3, 4 and 5, after substituting miuj^j Ajj by the expression (52). □ 

7 Appendix 

7.1 The amount of information 

In Definition 4.1, we state the formula to compute the total amount of information H , for 
any network J\f - even if J\f does not satisfy the hypothesis posed in §1.2. The non negative 
real number H measures the total amount of bits (i.e. on a logarithmical scale with basis 2) 
of the maximal number of different spiking-code patterns (cf. Definition 3.3) that appear 
recurrently in the network, from all the initial states. 
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This definition of H is based on its eventual application to Neuroscience. In fact, the 
number of different spiking-code patterns in the abstract networks that we study along 
this paper, depends on the relative timing among the spikes of different cells. The dif- 
ferent spiking-code patterns and the timing among the spikes characterize, according to 
neuroscientists, the ability of the nervous system to process or generate information (e.g. 
[19]). 

The total amount of information H in Definition 4.1, is not the entropy h: 
On the one hand, the mathematical definition of entropy in Ergodic Theory (e.g. [21]) 
does not measure the total amount of information that the system generates or processes, 
but measures the rate or velocity according to which the accumulated information asymp- 
totically increases (i.e. bits per second, when time, or the number of iterations, goes to 
+oo). So, according to the classical mathematical definition, the entropy is positive only 
if the accumulated amount of information increases with a positive rate forever in the fu- 
ture. This implies that the total amount of information H that the network can potentially 
generate or process along all its evolution, should be infinite, if the entropy h were nonzero. 

On the other hand, the networks that we study in this paper include, for instance, 
mathematical models of networks of biological integrate and fire neurons (e.g. [7, 20]), of 
coupled oscillators (e.g.[34, 38]), and of regulatory genes (e.g. [12]). These applied models 
can be translated, for instance via a Poincare return map, as dynamical systems obtained by 
iteration of piecewise contracting mappings acting on a finite dimensional Euclidean space 
(e.g. [12, 5, 38, 20]). But for C'^-generic piecewise continuous mappings of finite dimension, 
the limit set is composed by a finite number of periodic orbits, or in the best case, by a 
quasi periodic orbit (e.g. [8, 4, 12, 6]). Therefore, C'^-generically, the asymptotical rate h 
according to which the amount of information increases (the topological entropy), is always 
zero. 

Nevertheless, a null rate h of increasing information does not measure the actual amount 
of information H that the system generates or processes. In fact, if the number of cells, the 
number of different periodic orbits, and the periods of them are very large, then the total 
number of different code-patterns that the network can show is very large (e.g. [8], [9]). 
H is finite, because it asymptotically does not increase but becomes eventually constant. 
Nevertheless, H may be positive, and is indeed as large as the accumulated number of the 
(maybe very many) different code-patterns, regardless whether this number always increases 
or remains constant after some finite waiting time. 

7.2 The free dynamics of each cell 

By Definition 2.1, we assume that the free dynamics of each cell i is a continuous and deter- 
ministic dynamical system evolving, for instance, on a finite dimensional compact manifold 
Xi (of any finite dimension) which depends on i. So, if dim(Xj) > 2, the instantaneous 
state Xi of the cell i is a multi-dimensional variable living in Xj. 

In spite of the multi-dimensionality of the state variable Xi, the only "firing criterium" 
to decide when the cell i acts on the network, is the numerical instantaneous value of what 
we call its satisfaction variable Si. This real variable is like a Lyapunov function, i.e. it 
depends on the multi-dimensional variable Xi, and after composed with the determinisitic 
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dynamical system that governs Xj, the real variable Si depends on time. Besides, under the 
free dynamics, Si is increasing on time (c.f. Equation 2). Anyway, Si is not the state Xj of 
the cell. For any fixed value a > 0,a < 9i of Si (but not for the reset value a = 0), there 
may exist infinitely many possible states Xj of the cell i such that Si{xi) = a. 

In addition to the above general hypothesis, we assume restrictive hypothesis to call a 
variable Si the satisfaction variable of the cell i. We suppose that Si satisfies the differential 
equation 



where gi is any arbitrarily given positive C -function. 

The motivating results for the latter definition were recently obtained in [23] and [40] : In 
fact, a standard model would take into account only one real variable Si. So, the differential 
equation (53) would be substituted by dSi/dt = gi{Si). But a standard model is equivalent 
to what is called the "Phase Response Curve" (PRC) hypothesis, which tracks only the 
changes of the "phase" Si. As observed in [23], an analysis based on the PRC hypothesis, 
does not refiect the true dynamics of the cell. The multi-dimensional free dynamics of each 
cell may have, for instance, many periodic attracting cycles. So, certain large impulsive 
interference applied to the free dynamics of the cell i, may change the state Xj, making it 
jump from one basin of attraction, to a different one. So, it may induce a dynamics of the 
cell that is non periodic and irregular. This effect is called shared induced chaos [22]. 
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